arXiv:math/0503089vl [math.PR] 5 Mar 2005 


Proc. Indian Acad. Sci. (Math. Sci.) Vol. 114, No. 4, November 2003, pp. 309-318. 
Printed in India 


Random walks in a random environment* 


S R S VARADHAN 

Department of Mathematics, Courant Institute of Mathematical Sciences, New York 
University, NY 10012, USA 
E-mail: varadhan@cims.nyu.edu 


MS received 16 June 2004 
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1. Introduction 

A random walk on h d is a stochastic process {S n : n ^ 0} defined as 
So = 0, S„ = X\ -\ - \-X n for n ^ 1, 

where {A,} are independent and identically distributed random variables with a common 
distribution n(z) = P[X{ = z) for z £ . The relationship between the behavior of S„ as 

moo and properties of n{-) is quite well-understood and is easy to analyse, using often 
Fourier analysis as the main tool. 

For instance if kl n ( z ) < °°> the law of large numbers states that 

lim — = Y zjt(z). 
n->°» n ~ 


If JL-ez d l~| 2 7r ( 2 ) < °°j an£ I ^zeZ dZn ( z ) = '■hen the central limit theorem asserts that 
the distribution of S„/y/n is asymptotically Gaussian on with mean 0 and covariance 
C = {C„ } given by 

Cr.s — ^ Z.rZ.s R{z. ) ■ 


Cramer’s theorem on large deviations provides exponential rates of convergence of 



*This is essentially a transcript of the plenary talk given at the Joint India-AMS Mathematics Meeting held in 
December 2003 in Bangalore, India. 
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for sets A excluding the mean m = L-gz az7t(z)- Assuming that 
M(d) = £ e^ 0 >7T(z)<oo 


for 6 £ M , for a wide class of sets A, 


1 

lim - logP 

n-^>o o ii 


Sn 


£ A 


exists and is given by — inf re/ i I(x) where 
I(x) = sup [(0,x) — logM(0)]. 


The situation is quite different if we drop the hypothesis of independence of increments 
of S„ and replace it with the assumption that S„ is a Markov process. In other words, there 
exists p(z',z ) such that 

P[S n + 1 =z|Si,S 2 ,...,S„] = p{S n ,z). 

The random walk case considered earlier is a special case where p(z!,z) takes the form 
n{z — z!). Sometimes it is more convenient to denote p{z!,z) by 7r(z',z — z') so that the 
independent case is when n{z! , •) is independent of {. In this generality not much can be 
said. However if 7t(z',z) is periodic in z! , the phase gets averaged out and some homoge¬ 
nization takes place with 7i(z',z) getting effectively replaced by an averaged ft(-). Results 
on law of large numbers, central limit theorem and large deviation estimates can be estab¬ 
lished, with some extra work, quite similar to the independent case. 

We will investigate the case when n(z! ,z) are random but spatially homogeneous in z!. 
This can viewed as a limiting version of the periodic case when the period becomes large. 


2. Formulation 

We will start with a probability space (Q,E ,P) on which 1 d acts ergodically as a family 
T z of measure preserving transformations. We are given Jr(oj.z) which is a probability 
distribution on Z' / for each ft), that are measurable functions of ft). One can then generate 
random transition probabilities 7t(co,z',z) by defining 

7t(C0,z',z) = TZ{Xj(0,z). 

For each ft), 7z{(0,z!,z) can serve as the transition probability of a Markov process on 
I/ 1 and the measure corresponding to this process, starting from 0, is denoted by Q m . 
This is of course random (depends on ft)) and is called the random walk in the random 
environment ft). One can ask the same questions about this random walk and in some 
form they may be true for almost all omega with respect to P. The law of large numbers, 
if valid, will take the form 
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Such statement concerning the almost sure behavior of Q a for almost all co with respect 
to P are said to deal with the ‘quenched’ version. Sometimes one wishes to study the 
behavior of the ‘averaged’ measure 



( 2 ) 


The law of large numbers is the same because o is equivalent to 


Q a): lim — =m(P) = 1. 


On the other hand, questions on the asymptotic behavior of probabilities, like for 
instance, the central limit theorem or large deviations could be different for the quenched 
and the averaged cases. 

A special environment called the ‘product environment’ is one in which n((0,z',z) 
are independent for different z! and have a common distribution [5 which is a probability 
measure on the space ./# of all probability measures on 7L d . In this case the canonical 
choice for fl is the countable product of . M. The product measure having marginals /3 is 
of course the choice for P. 

One can consider the continuous versions of these problems. For instance instead of 
the action of we can have acting on (OJ.E. P) ergodically and consider a diffusion 
on R d with a random infinitesimal generator 


(j Z"°m)(x) = —(Au)(x) + (b((0,x), (Vw)(x)) 


(3) 


acting on smooth function on R d . Here b(o).x) is generated from a map b(co): — W 1 
by the action {t a } of 


b(co,x ) = b(x x a>). 


Again there is the quenched measure Q a> that corresponds to the diffusion with generator 
Jzf® that starts from 0 at time 0 and the averaged measure that is given by the same 
formula Q. This model is referred to as diffusion with a random drift. Exactly the same 
questions can be asked in this context. 

3. Results: One-dimensional case 

We shall describe the results in the one-dimensional case, which is quite well-understood. 
A very good reference with a full bibliography is a survey by Zeitouni 191 at the Beijing 
congress as well as his notes from St. Flour ED- For simplicity we will take the special 
case of the product environment in which only n{b).z,z.+ 1) are non-zero and are random 
variables p(z), q(z ) = 1 — q(z) that are independent for different values of z, being the 
distribution on [0,1] of p( 0). To avoid some technical details we shall assume that /j has 
no mass near the edges i.e. is supported on a closed subinterval of (0,1). 

The question of when S„ is transient was answered in 0. 

Theorem 3.1. In order that 


Q a lim S n = +°° =1 
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a.e. P it is necessary and sufficient that 
P( 0) 


log 


q( o). 


/ log (dp) > o. 


(4) 


In the original random walk where p(z) = p is a constant this is equivalent to p > 3 °r 
p — q > 0. In such a case the law of large numbers asserts that 

S n n 

lim — = p — q> 0. 

72—>°o yi 

In our context the law of large numbers, also proved in (§|, states the following theorem. 


Theorem 3.2. 


,. S n 
lim — = m 

n->° » n 


a.e. Qf 0 for almost all CO with respect to P where m is given by 


r i-g[f] 

m = < 1 +£ lp]’ 

0, 


ifE[ f]<l, 

otherwise. 


(5) 


It is therefore possible that £[log^] > 0 while E[j] f 1, in which case S n —> °° but 

c 

^ —> 0. In the original random walk this could not happen. In the one-dimensional case 
further detailed analysis can be carried out in this case. The problem comes from ‘traps’ 
where the environment conspires to hold the particle for a long time. As the particle 
moves to it encounters increasingly deeper traps that hold it even longer producing 
a critical slowing down. This phenomenon discovered by Sinai 0 is well-understood. 
In one-dimension the traps can not be avoided. Therefore the one-dimensional case is 
strikingly different from the higher dimensional ones. 

Assuming that m > 0, one can study the behavior of £, n = (S n — nm)/ffin and ask for 
a central limit theorem. It turns out that the fluctuations of <*„ have two sources; from 
the environment {p{x)\ 0 ^ x ^ nm] and fluctuations of the walk in this environment. 
Under Q m , the distribution of is Gaussian with a random mean which depends on the 
environment and has an asymptotic Gaussian distribution by itself. Hence while there is 
a central limit theorem for the averaged Q there is none for Q m . This phenomenon is not 
expected to persist in higher dimensions. 

There are large deviation results regarding the limits 


lim — log <2“ 

n->oo n 



= I{a) 


and 


lim - log Q 

m—>°° n 



= 1(a). 


The difference between I and / has a natural explanation in terms of the large deviation 
behavior of the environment. It is related to the following question. If at time n, a particle is 
near na instead of being around nm which is what we should expect, what does it say about 
the environment in [0,«a]? Did the particle behave strangely in a normal environment or 
did it encounter a strange environment? It is in fact a combination of both as is seen in the 
relation of 7 to / which is essentially Bayes’ rule. See for instance 0 and 0. 
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4. Higher dimension 

lid 2 the law of large numbers and central limit theorems are not that well-understood. 
For instance the questions of recurrence, transience and the existence of a non-zero limit 

c 

m = have only partial answers with sufficient conditions that are not that easy 

to check. Even when we limit ourselves to a product environment there is no clear analog 
of the condition 0. 

However if d ^ 3, under some symmetry conditions that ensure that m = 0, a central 
limit theorem was proved by Bricmont and Kupiainen 0, provided the randomness in 
the environment is small. A recent preprint by Sznitman and Zeitouni 0 provides an 
alternate proof. 

Large deviation results however exist in much wider generality, both in the quenched 
and the averaged cases. The large deviation principle is essentially the existence of the 
limits 

lim -log£[exp[(0,S„)] = 'F(0). 

«->“> n 

The expectation is with respect to Q a or Q, which could produce different limits for X P. 
The law of large numbers and central limit theorem involve the differentiability of 'T at 
0=0, which is harder. In fact large deviation results have been proved by general sub¬ 
additivity arguments for the quenched case. Roughly speaking fixing ft), 

Q w [S k +i ~ (k + l)a\ ^ Q m [S k ~ ka] x Q^ a [S t ^ la\. 

One can then use some version of the sub-additive ergodic theorem. This idea has to be 
cleaned up a bit, but is not hard. See for instance CD or 1 1]. We will however explore, in 
the next two sections a proof of the large deviation principle for the averaged case and an 
alternate proof for the quenched case. 


5. Large deviations: The averaged case 

We want to prove that the limits 


lim -logQ 

n^oo ft 



-1(a) 


(6) 


or equivalently 

lim ilog£®[exp[(0,S„)]] = T , (0) 

n=°° n 

exist. The problem is that the measure Q is not very nice. As the random walk explores 
U 1 it learns about the environment and in the case of the product environment, when it 
returns to a site that it has visited before, the experience has not been forgotten and leads 
to long term correlations. However, if we are interested in the behavior S„ ~ na with a / 0, 
the same site is not visited too often and the correlations should decay fast. This can be 
exploited to provide a proof of 0. 

One can use Bayes’ rule to calculate the conditional distribution 


Q[Sn+ 1 =S n +z\Si,S 2 ,...,S„] =q(z\w) 
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where w is the past history of the walk. Before we do that it is more convenient to shift 
the origin as we go along so that the current position of the random walk is always 
the origin and the current time is always 0. Then an n step walk looks like w = {So = 
0,S_i,... ,S_„}. We pick a z with probability q(z\w). We get a new walk of n + 1 steps 
w' = {Sq = . ■ ,S^ n+1 j} given by S'_^ k+ ^ = S_& — z for k > 0. We can now cal¬ 

culate q(z\w). We need to know all the numbers {k(w 1 x,z)} of the number of times the 
walk has visited x in the past and jumped from x to x + z- It is not hard to see that the a 
posteriori probability can be calculated as 

, . , /7r(z)n z ,7r(z0* (w ’ o ’ z,) /3(d7r) 

q {z\w)- j n ^,)*(w,o, 2 ')/ 3 ( d7r ) 

While this makes sense initially only for walks of finite length it can clearly be extended 
to all transient paths. Note that although we only use k(w,0,z!), in order to obtain the new 
k(w',0,z') we would need to know k(w,z,z!)- 

Let us suppose that R is a process with stationary increments { z.j \ ■ If the increments 
process were ergodic and had a non-zero mean a we can again make the current position 
the origin and the process will be transient. q(z\w) would exist a.e. R and can be compared 
to the corresponding conditional probabilities r(z\w) under R. The relative entropy 


H(R) = E r 


£r(z|w)log 

z 


KzH 

q(z\w) 


is then well-defined. 


Theorem 5.1. The function 


1(a) 


inf H(R) 

R: fz i dff=a 
R ergodic 


defined for a extends as a convex function to all ofR d , and with this /, © is satisfied. 

The proof, which uses basic large deviation techniques, can be found in 0. 

Remark 5.1. It is interesting to note that the rate functions 1(0) and 7(0) coincide at 0 and 
can be calculated explicitly. Let ^ be the convex hull of the support of /I in .// (If 1 ). Then 

7(0) =7(0) = - inf inf logjy^te). 

0eR rf " 

In particular 1(0) > 0 if and only if 0 is not in the range of £ zn(z) as n varies over Tf. 
This is referred to in the literature as the ‘non-nestling’ case. 


6. Large deviations: The quenched case 

Although a proof using the subadditive ergodic theorem exists, we will provide an alter¬ 
nate approach that is more appealing. We will illustrate this in the context of Brownian 
motion with a random drift 0 . 
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We can define a diffusion on Q with generator 

% = \a +<*(»), V), 

where V = {/),} are the generators of the translation group { x x : x € R' 7 }. This is essen¬ 
tially the image of lifting the paths x(t) of the diffusion on R rf corresponding to Jzf® to £2 

by 


(o{t) = r x{t) (o. 


While there is no possibility of having an invariant measure on R d , on £2 one can hope to 
find an invariant density <p(©) provided we can find (p ( 0 )) ^ 0 in L\ ( P ), that solves 

\A<p = V-{b(p ). 

If such a (p exists, then we have an ergodic theorem for the diffusion process Q m corre¬ 
sponding 2z? on £2, 


limy J f(co(s))ds = J f(co)(p(co)dP a.e. Q a a.e. P. 
This translates to an ergodic theorem on R d as well 

lim jJ f(co,x(s))ds = J f(co)(p(co)dP a.e. Q a a.e. P 
where now Q ( " is the quenched process in the random environment. Since 


(7) 


x(t) = [ b(co,x(s)ds + p(t), 
Jo 


it is clear that 

lim ——^ = [ b(co)(p(co)dP a.e. Q m a.e. P 
t J 

providing a law of large numbers for x(t). While we can not be sure of finding <p for a 
given b it is easy to find a b for a given (p. For instance, we could take b = V(p/2(p. Or 
more generally b = (V<p/2<p) + (c/cp ) with V • c = 0. If we change b to b' = (V (p/2(p) + c 
with V • c = 0, the new process will have relative entropy 


e qi 


I b r ,(0 


~f 

2 Jo 


b(co(s)) 


V<P(&{s)) 

2 <P(a(s)) 


c(co(s)) 

<p(a(s)) 


Moreover, for almost all co with respect to P, almost surely with respect to Q b ' °\ 

Vffl c 

— -1— 

2 (p (p 


lim JJ 

t^oo f 


J W + ? ^P = JciP. 


If we fix / cdP = a, the bound 


liminfylogg* 


'x(t) 

- ^ Cl 

>-- [ 

b 

t 

2 J 

2 (p (p 


(pdP 
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is easily obtained. If we define 


I{a) 


inf 

Vc=0 
/ cAP=a 


1 

2 


/ 


b 


V<p 
2 cp 



(pdP, 


then 


1 


lim inf — log Q 
t 


(0 


x(0 

t 


> -/(a). 


Of course these statements are valid a.e. Q <a a.e. P. One can check that I is convex and 
the upper bound amounts to proving the dual estimate 

limilog^V 0 -^] <¥(0), 

t^OO f 


where 


t//(0) = sup[(a, 0) —1(a)}. 

a 


We need a bound on the solution of 

u t = + {b, Viz) 

with u( 0) = exp[(0,x}]. By Hopf-Cole transformation v = log u this reduces to estimating 
v, = ^Av+ i||Vv|| 2 + (ft, Vv) 

with v'(0) = (0. x) . This can be done if we can construct a subsolution 
iv • w + ^ 11Vw11 2 + (b,w) < \jf(d) 

on O, where w: £2 —► satisfies f wdP = 0 and w is closed in the sense that D/vvy = DyW/. 

The existence of the subsolution comes from convex analysis. 


1 1/(0) — sup 
<P 

Vc= 0 


= sup sup inf 

(p C U 


2 (p (p 
1 


= sup inf sup 

(p U C 


J (c,&)dP— 2 / 

J (c,Q + S7u)dP — i J 
J (c,d + S7u)dP — j 


(pdP 


b-Yl-E. 

2 (p (p 

b-Yl-l 

2(p (p 


■ sup inf / 

(o u J 


sup 


(c,0 + Vm) — — 


b — 


V<p c 
2 (p (p 


<P 


(pdP 


(pdP 


d P 
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sup inf 

(P xv closed 
Y r r>—Q 


(n xv closed J 2 2 


w closed 


fxvdP=d 


fxvdP=0 


xv 

fxvdP=0 T 


xv 

r,.,AD—a r L 



fxvdP=6 


xv closed 


xv closed q) 2 2 


inf sup -V• w+ (b,w) + -||w|| 2 


j wdP=8 


which proves the existence of the subsolution. 

Remark 6.1. This can be viewed as showing the existence of a limit as e —> 0 (homoge¬ 
nization) of the solution of 



with u £ (0,x) = f(x). The limit satisfies 

Uf = ^(Vm) 


with m(0,x) = fix). 


This can be generalized to equations of the form 



We have left out the details as well as the hypothesis needed to prove the results. They 
will appear in 
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